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1. Introduction 

The abstractions wc have for serial programming are powerful; concepts like data types, variable 
binding, generalized operators, the "subroutine." These concepts are our most powerful tools in the 
development and undci-standing of large systems for conventional serial machines. This paper presents a set 
of similar abstractions for parallel computation and describes a distributed problem solving language which 
implements tlicrn. 

These abstractions are the cauldron, a mechanism for organizing inference into distinct reasoning 
contexts; the fmmc, a way of modularly describing tlie components of tliesc contexts; and the goal-node, a 
mechanism for bringing a particular reasoning context to bear on a specific tiisk. The development of these 
abstractions, in addition to providing a working base for experiments in parallelism, gives a new perspective 
on the role of "representation" in reasoning systems. 

/./ Main Points 

This paper develops three mechanisms for organizing large distributed reasoning systems: 

Cauldrons- A chunk of computational activity containing a set of assertions and 
inferential mechanisms for manipulating them. 

Frames - A way of grouping assertions into "chunks" of knowledge. For insUince, 
a frame for a particular bl(K'k contains knowledge -- in the form of propositional 
descriptions -- about that block. 

Goal-nodes -- A mechanism for invoking a collection of Jrames into a particular 
cauldron to perform some task. 

A cauldron is a restricted problem solving context. In a cauldron, reasoning takes place separated from 
the main stream of computation, which ideally consists only of a system of interacting cauldrons. 

ITie contents of a cauldron arc assertions, some of which may be computationally active in the sense that they 
may produce side effects in response to changes or events in the cauldron, lliese side effects might be new 
assertions, remarks to the console, or the creation of other cauldrons. Pattern-invoked rules or inter-cauldron 
communcation channels are Insumces of these active assertions. The cauldron meuiphor is meant to invoke 
tlie vision of an actively changing "brew" of rules and assertions interacting and combining to form new 
conclusions and results. 
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\ frame is a collection of assertions which may be added to a cauldron. Since these assertions may be 
rules or other computationally active forms, the knowledge a frame contains may be eitlier procedural or 
declarative. The presence of this active knowledge allows a piece of knowledge to contain its own 
interpretation. Kor instance, the statement "Jack is the brother of Jill" might share a frame with the rules of 
interpretation defining whal it means to be a brother. 

A frames' contents may be defined by pointers to other frames as well as by its explicit contents, allowing a 
frame to indirectly ificlude other frames. The frame describing Jack -- for instance -- might indirectly include 
the rules and assertions defining "what it means to be a brother," which would interpret the assertions about 
brotherhood in Jack's description. In an identical manner, relations such as AKO can be interpreted in a 
manner specific to the reasoning context. Note that tliis inclusion mechanism makes no epistemological 
assumptions, but only describes contexts in which an epistemology may be defined and interpreted. 

A goal-node is a way of tying frames and cauldrons together to solve a problem.' In a response to an 
explicit goal of the problem solver, a goal-node creates a cauldron to work on that goal and adds the 
assertional contents of a certain set of frames to that newly created cauldron. 

For insumce, when trying to place one block atop another, a triggered goal node will create a cauldron which 
contains frames for the bUK^ks involved as well as a frame - or frames - describing the technique for making 
one bl(K'k su|)poit another. Since the assertions in a frame may be rules, a frame may contain the declarative 
procedure for peforming some task. 



ITiese three mechanisms provide a facility for abstraction which declarative programming languages, 
even distributed ones, do not generally provide. ITie goal node makes possible the creation of reasoning 
subcontcxts in much the same way that the subroutine allows creation of a variable-binding context for the 
execution of a procedure. In an extended analogy to traditional subroutine invocation, the cauldron Uikes the 
place of the stack frame, the frames take the place of binding environments andihc function definition, and 
the goal-node takes the place of the calling mechanism. 



1. "Solving a problem" is intended in its most general sense. It may refer to writing a sonnet, figuring out 
what a tool does, or solving an electrical network. 
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/.2 An Example 

This example portrays a cauldrons-based reasoning program pcforming uisks in the blocks world. The 
environment in which it operates is a classical blocks world where die program performs simple blocks world 
Uisks, using frames and goal nodes to carry them out in a reasonably sophisticated manner. 

Several important points are illustrated in tliis example: 

o The cauldron invocation mechanism as a way of capturing die application of a 
particular technique to a given problem. 

o The functionality of separating intentions into needs which are reasoned about 
and goals which arc acted upon. 

o The frame mechanism as a way of modularizing knowledge into contours of 
relamnce based on what knowledge is useful for particular Uisks. 

o The frame-sharing mechanism as a way to communicate relevant information 
between cauldrons. 

o The homogenous representation of both program and data as active or inactive 
elements of frames, allowing the simple attachemcnt of censors and critics to 
arbitrary pieces of knowledge or pr(x:edure. 

These points encompass bodi the mechanisms which tJiis paper presents -- cauldrons and frames and 
goal-nodes -- and various "stylistic" principles which make programs using diese mechanisms easily 
modifuible and extensible. 



The bliKks world starts out as in Figure 1. Initially, there is a single cauldron, BLOCKS-CAULDRON, to 
which tasks are given. Figure 2 presents diis cauldron with its set of initial assertions, rules, frames, etc: 

llic first task given to die program is die straightforward problem of placing BLOCK 1 on top of 
BL0CK2. A goal-node in BLOCKS-CAULDRON, triggered by die assertion of diis goal, creates a subcauldron 
for fulfilling it. 'ITils subcauldron contains a reasoning context, made up of rules and assertions, tiiilored to 
die Uisk at hand. 

In diis particular case, die cauldron contains die following elements: 
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Table 




Kig. 2. Blocks Cauldron 




o The physical dcUiils of BLOCK 1 and BL0CK2. Their size, shape, color, position, 
and relations with adjoining blocks. 

o What it "means" to be a block. This incorporates such axioms as "if a block 
doesn't support anything, it is clear", or that "if you are looking for space for a 
block (through an automated oracle connected to the blocks world simulator) you 
will generally fmd it". 

techniques for interpreting new "sensory" knowledge. This is essentially a set 
of rules for transforming between the assertions of the blocks world simulator and 
the internal representations of the program. 
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liasic techniques for Llic domain. Ihis is knowledge which is shared by all 
techniques which BLOCKS-CAULDRON might invoke; it includes knowledge about 
how to know if you're finished with a tiisk, principles for maintaining a consistent 
world model between separated cauldrons, and interlocks for unique resources 
(such as hands). 

o Techniques for perforrrring the task. This is a traditional bliKks-world program 
which ensures preconditions, moves, grabs, moves, and lets go. These techniques 
are implemented as statc-to-state rule-chains which fire off of resulLs and 
preconditions to generate actions and new results. The handling of unsatisfied 
preconditions is demonstrated later in tliis example. 

o Censors which are particular to the sort of Uisk being performed: This is where 
knowledge such as the unsuitability of pyramids as supports is stored. In the 
current implementation the knowledge here is anecdotal, and does not take tlic 
form of complex "theories of support suitablity". 

These individual "pieces of knowledge," stored as/m///r asscriions in BLOCKS-CAULDRON, are "activated" 
into the newly created subcauldron. This process is depicted in Figure 3. Activation involves running tlie 
deduction mechanism over the new set of assertions and rules, with reference to those rules already in die 
cauldron. 

The subcauldron now contains several sorts of "how-to" knowledge: procedural knowledge in the form 
of rule-chains, censor-knowledge in the form of simple condition-triggered rules, and prerequisite checkers 



I'ig. 3. Activation of a cauldron 




Doing 



BLOCK1 
supports 

BLOCK2 



lause 



Cauldrons 



for enabling llic procedural rule-chair.s. To begin, tlic prerequisite checkers, noting that BL0CK2 can be 
grasped and that there is adequate space for it on BLOCK 1, enable the support-making rule chain, which 
proceeds to pick up BL0CK2 and carry it over to BLOCK 1, where it is released. The subcauldron, its goal 
acheivcd, now updates the appropriate frames in BLOCKS-CAULDRON (to reflect the changed state of 
BLOCKl and BL0CK2, particularly) and dissolves itself. 

Next, the program is given tlie more complex Uisk of placing BL0CK2 on top of BL0CK3; Uiis Uisk is 
more involved because BLOCKS is already on top of BL0CK3. as in Figure 4, and tlie program must recogni/e 
and remove this obstruction. When the goal of making 8L0CK3 support BL0CK2 is recognized, a goal-node 
creates a cauldron, just as before, to pursue the goal. The contents of tliis cauldron, as before, is determined 
by the frames activated into it. This arrangement is depicted in l-igure 5. The cauldron - or to speak 
precisely, its interpreted contents - first checks to see if it is okay to grasp BL0CK2. and seeing that it is, 
checks to see tliat there is space for BL0CK2 t)n BLOCKS, thus noting the presence of BLOCKS. Seeing the 
obstacle, the cauldron generates upwards to BLOCKS-CAULDRON a //m/for BLOCKS to not support BLOCKS, 
including an explanation of why it is needed. 

BLOCKS-CAULDRON, receiving notice of this need, and noting no evidence to suggest its improperiety, 
generates tJie ^'ot?/ of satisfying iL This new goal soirts up another cauldron, as shown in Figure 6, 

with an entirely different set of expertise from the first cauldron. The contents of this NOT-SUPPORTS 



Kig.4. I he mocks World after (MAKE (BLOCKl SUPPORTS BL0CK2)) 
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hig. S. A cuuldron is created to make BLOCKS support BL0CK2 




V'lg. 6. Figuring out how to satisfy a prerequisite 




cauldron - (he rules and assertions which provide its expertise and expectations -- are very dijferent from the 
contents of any MAKE-SUPPORTS cauldrons. The procedure represented in tlic NOT-SUPPORTS cauldron 
looks at all of the bkK'ks and tries to find a s;>fe place to discard BLOCKS which wil not disrupt any ongoing 



Huasc 



Cauldrons 



Uisks/ The NOT-SUPPORTS cauldron decides tliat BLOCKS can be put on top of PYRAMID 1, and generates a 
need for that support relation to exist. This is transformed into a goal which triggers the activation of still 
another cauldron using the same general MAKE -SUPPORTS knowledge as tlie first. This new subcauldron 
proceeds to pick up BLOCKS, carry it over to PYRAMIDl. and attempt to release iL This arrangement of 
cauldrons is shown in l-igure 7; Figure 8 depicts the blocks world at this moment. Unforumately. BLOCKS 
cannot rest securely on top of PYRAMIDl and this problem is reported by the blocks world simulator a 
statement about the instability of BLOCKS asserted into the MAKE-SUPPORTS cauldron which aUcmpted to 



I'Ir. 7. Satisfying (he prerequisite 




2. Inter-Uisk interference is mediated by a protection mechanism (as in HACKER (Sussman761). When a 
cauldron begins to manipulate a block, it adds the suitement diat tlie block is protected to the frame for the 
block as well as to a repository BLOCK-PROTECTIONS frame in BLOCKS-CAULDRON. Ihe 
NOT-SUPPORTS cauldron has Uiis BLOCK-PROTECTIONS frame activated into it so diat it can identify 
conflicts with tiisks currently in progress. 
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Kig. 8. Trying to put BLOCKS on top of PYRAMIDl 



Blockl 




release BLOCKS on top of the pyramid. I'his assertion is recognized by the cauldron (this is the second 
MAKE -SUPPORTS cauldron) and a report of the difficulty is percolated up to BLOCKS-CAULDRON, with two 
results: 



o A critic is created to catch subsequent cauldrons about to attempt the same 
ill-founded goal (the goal of putting BLOCKS on top of PYRAMIDl). I'his critic is 
stored in the frames for BLOCKS and PYRAMIDl, which are both defined inside of 
BLOCKS-CAULDRON. 

o An assertion describing the erroi' Is added to die cauldrons which brought about 
the error-producing need (the NOT-SUPPORTS cauldron and the initial 
MAKE -SUPPORTS cauldron) in the first place. 

Reacting to the error assertion, the NOT-SUPPORTS cauldron looks for an alternate location for BLOCKS, and 
decides to place it atop BL0CK4. This decision generates two assertions in BLOCKS-CAULDRON: an 
appropriate need for BL0CK4 to support BLOCKS and a statement that the error of the misguided 
MAKE -SUPPORTS cauldron has been "handled". ITie second assertion leads to the dissolution of the erring 
MAKE -SUPPORTS cauldron, while the first generates a goal of having BL0CK4 support BLOCKS, which 
triggers the creation of a new cauldron working on that goal, as show in Figure 9. 

This new cauldron, seeing diat BLOCKS is already grasped, moves to BL0CK4 and drops BLOCKS on 
top of it The blocks world is now as depicted in Figure 10. The cauldron responsible for Uiis, its Uisk done 
and having updated tlie appropriate frames in BLOCKS-CAULDRON, dis.solves itself. Similarly, the 
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Mg. 9. Recovering from the error 




Mg. 10. The blocks world after BLOCK 3 has been cleared 



Block 1 
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NOT-SUPPORTS cauldron, seeing Its goal safely acheivcd, dissolves ilselfaiong with tlic others. 

When a frame is changed, the cauldrons into which that frame is invoked arc updated. For instance, 
when the frame for BL0CK3 is suitably changed by a cauldron affecting BL0CK3, the change is asserted into 
any cauldron into which the frame for BL0CK3 has been invoked. Thus, when the second MAKE -SUPPORTS 
cauldron (which tried to put BLOCKS on top of PYRAMIDl) picked up BLOCKS from BLOCKS, ii updated the 
frame for BLOCKS to reflect tlie removal. When tliis fact reached the first MAKE -SUPPORTS cauldron 
(because it contained tlie frame for BLOCKS), the prerequisite checkers recognized that there was nt)w space 
for BL0CK2 on BLOCKS, making it possible to move BL0CK2 as soon as tlie hand became free. Thus, when 
BLOCKS is finally released, and the program's hand is free, the program moves over to BL0CK2, grabs it, 
carries it over to BLOCKS and releases iL This done, the first MAKE-SUPPORTS cauldron dissolves itself after 
updating the appropriate frames in BLOCKS-CAULDRON, leaving the blocks world as in I'igure 11. 

Next we ask the program to place BLOCKS on top of PYRAMIDl. I'hc program refuses, explaining 
(given the critic which was created earlier) diat BLOCKS would be unsuible if this were attempted. If tliis goal 
had been the result of one of its own deliberations, for instance a NOT-SUPPORTS attempt, it would be able 
to recogni/.ed the expected error and try another approach or strategy. (For insumce trying to find another 
space for the block). 



I'ig. 11. Ihcniocks World after (MAKE (BLOCKS SUPPORTS BL0CK2) ) 
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1.3 Learning with F mines 

This example has shown goal-nodes, frames, and cauldrons in action performing a series of tasks. The 
notions of frames and goal-nodes, however, support several powerful mechanisms for learning from 
experience and mistakes. This section offers a few notes (without extensive examples) on these mechanisms. 

The fii-st, implemented in an earlier version of the blocks world program presented here. rec{)gni/.ed 'error 
assertions' like that produced by the misguided cauldron in the example. It then initiated a sub-cauldron to 
hypothesize a reason for tiie failure: tliis reason then became a cmvor applied to MAKIvSUPPOk T activities 
in general. Unfortunately, the hypothesis generator, as first coded, tended to over-generali/c and — since the 
implementation contains no provisions for automatic truth maintenance ™ eventually paralyzed the problem 
solver by the image of disaster at every turn. 

The second, used more extensively in reasoning about connectivity in circuits, used the idea of sioring 
ui'livalion pa/terns as a way of constructing new frames. A successful cauldron — its goal acheived — could 
collect its contents (the resulLs — in terms of intermediate conclusions and primcd-to-Hre rules) and make 
them (or add tlicm to) frames in the cauldron above it. In particular, the circuit reasoning program computed 
a lot of fanouts in the process of trying to find breaks in a represented electric circuit. Hy adding these fanouts 
to the frame describing the ciruit, later analysis tasks could proceed quite quickly — skipping endless chains 
of fanout specifications. In the bUxjks world, where the frames for blocks change so often, this was less 
effective; restoring past state could seriously confuse the problem solver rather than clarifying or improving 
its progress. 

A later implementation of cauldrons might make more use of these facilities, with powerful tools for storing. 
pruning, and restoring partial st;Ucs of the problem solver. 
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2. Restricting and Distributing Reasoning 

This section describes Lhc cauldron mechanism as a mechanism for resiricling and distributing 
reasoning over several distinct inferential "processes". While not delving into the internals of an 
implementation, it details the motivations for its design and contrasts it with other distributed reasoning 
systems. 

2.1 Cauldrons 

This research develops a mechanism for dellning and mainUiining restricted problem solving 
computations called cauldrons. Cauldrons arc explicitly defmed problem solving contexts in a reasoning 
program. An individual cauldron consists of a declarative program interpreter roughly similar to AMOKl) 
ldeKlcer78|, a database of assertions, rules and other slmctures on which tliis interpreter acts, and control 
information which it uses in interaction with other cauldrons. 

The cauldrons' "contents" arc the set of assertions on which the interpreter operates. Rules and special 
constructs such as side effect generators and inter-cauldron communication channels arc simply special cases 
of assertions. These rules and active assertions may be examined and manipulated by other rules and active 
assertions in the cauldron just as easily as diey manipulate tlie assertions and incrences of some particular 
domain.^ 

One fundamental assumption of this research has been the aciivc role of knowledge in the reasoning 
process. The concept of apple has far more "attached" to it than merely color, shape, si/.c, or flavor. It carries 
the knowledge tliat you perhaps shouldn't cat it when green, tJiat you can cut out its soft spots with a knife, 
and that planting its seeds can make you feel exceptionally nature-loving. TTic view of knowledge as merely a 
collection of statements to be examined is impoverished because it excludes a vast array of censor-knowledge, 
procedure-knowledge and "contextual interpretation" knowledge. Casting knowledge as a passive "accessed" 
clement of the reasoning process sterilizes a representation, draining it of expressibility. This is a fate which 
this research has tried to avoid by discarding the idea of "database access" as a distinct operation. Cauldrons 



3. Kornfeld's Hther [Kornfeld82] lacks this feature; Rules, as sprites, are not normally looked at by other 
rules or sprites- there is a clear separation between assertions and rules in Ktlier. something which cripples 
attempts at reHection or self modification. If a rule must determine what other rule led to some action or 
conclusion - in order to eidier disiible it for similar situations or generalize it to other situations - die ability 
to examine rules with other rules is neccessary. 
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arc not a daUibasc from which "facts" arc fetched, tlicy arc a melting pot of techniques and knowledge into 
which "facts"* arc actimted. Rules, cfTcctors, and examiners hence becoinc only especially "active" 
assertions. 

A given cauldron is able to manipulate other cauldrons through these "active" assertions. Through tliis 
mechanism, a cauldron can eitlier create new cauldrons or make assertions in existing cauldrons. This ability 
of cauldrons to create other cauldrons defines a hierarchy of cauldron invocation. The arcs of this hierarchy 
describe a parent-child rekition, where the cauldron created is referred to as the child of its creator parent 
cauldron. This hierarchy is intimately tied to the frame and goal-node abstraction presented in tliis paper. 
Generally the goal-nodes and frames which contribute to a given cauldron arc present -- as single FRAME or 
GOAL -NODE assertions -- in their parent cauldron. Conversely of course, the frames and goal-nodes existing 
as assertions in a cauldron are generally used to instantiate and define its children. 

While the primitive mechanisms for cauldron creation and activation are available to the rules and 
assertions of each cauldron, programs generally use the goal-node and frame abstractions sketched in the 
introduction.* The goal-node/frame mechanism supports a useful abstraction over the bare cauldrons 
implementation, providing a protocol for organizing knowledge and mediod. 

2,2 Distinctions from other Distributed Reasoning Systems 

This section will try to motivate some of the features described in the previous section by comparision 
with other schemes for distributed reasoning. 

The Connivcr [Mcl)ermott74] ctxt mechanism may be considered a subset of cauldrons, as it creates 
new subdomains by "layering" new assertions onto die daUibasc so that Uiey can be "pushed" -- defining a 
new layer of context - and "popped" -- returning to a previous layer. Mut die use of layered contexts, while 
gaining the "computational instantiation" aspect of cauldrons, fails as a restriction mechanism. Its problem 
lies in dragging die entire ancestor context into die computational arena.** This is cumbersome in most cases. 



4. Where a fact may as easily be "how to paint a block" as "the block is red". 

5. 1'he goal-node and frame mechanisms were initially implemented using diesc explicit 
cauldron-manipulation primitives, and only after diosc explicit implementations had evolved were Uiey wired 
into die implementation. 

6. You can get around this problem by adding diings to an empty context, but diis usuips the hierarchy 
defined by context-creation, which is still important from a control standpoint. 
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but may sometimes be necessary- a cauldron instantiation does have the option of copying the entire present 
cauldron into the new one. Coiniiver's layered context mechanism may be viewed as Creating a hierarchy of 
assumption with new context layers being new branches from a single tree of deduction, while die cauldron 
mechanism defines a hierarchy of invocation.' The hierarchy of invocation reHecLs both represenuitional 
abstraction and meta-kiiowlcdge betwcMjn levels: a cauldron is "superior" to another if it interprets and uses its 
results. An inferior cauldron will usually know ///ore about certain things than the superior cauldron which 
invoked it (such as how to perform its uisk), but will in turn know /m about other Uiings (such as why it was 
invoked in the lli-st place). The cauldron hierarchy is determined not by accumulated layers of conclusions, 
but by invocation, with each invocation guided by ^knowledge about the puipose and performance of levels 
below it. 

This design inherently rcllects a philosophy for tlie control of parallel reasoning processes. While it is 
possible to implement a layered ct)nicxt inechanism in a cauldron system, the general philosophy is that 
usually tliis is the wrong thing to do. Ihe design of cauldrons stresses a hierarchy of invocation control over a 
hierarchy of accumulated assumptions. 

riMS systems such as I)i)yle's [I)oyle78j may be viewed as a systematic dissolution of the Conniver tree 
of cumulative assertions. Using a IMS both gets around the costs of insumtiating new contexts for each push 
and, more importantly, permiLs die removal of an individual "pushed" assertions in a long chain of "pushes" 
without having to regenerate die entire chain. It docs diis by keeping track of the "local causes" of each push 
and further by making each assertion be a push. Thus the tree of pushes is broken into a colleclion of the 
local interactions (dependencies) for each push. The problem with diis dissolution is diat tlie Conniver 
hierarchy of assumption also contains control information and results of considerations which the I MS may 
well remove. The solution to diis in AMORD[deKleer78I is to explicidy define certain types of assertions to be 
sancrosanct as far as the TMS is concerned. I argue diat it is preferable to retain an explicit hierarchy of 
control - storing control information and results at different levels in die cauldron invocation hierarchy -- 
while performing maintenance of hypodieUcals dirought explicidy accessible mechanisms on each level 
(within each Individual cauldron). 



7. Cauldrons actually supports a hctcrarchy of invocation, allowing a cauldron to have more than one parent. 
While I can easily imagine schemes in which diis would be useful. I have yet to actually use such a feature in 
any slighdy real domain. Such a "godparent" relation might be useful when a number of separate cauldrons 
are interested in die results of a given compuUition; each interested cauldron can be a "godparent" to a single 
cauldron performing the computation. 
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The ACrORS paradigm [Hcwiu76| cJifFcrs from cauldrons in two distinct ways: the size of the agents 
involved and the existence of a clear control structure between agents at dilTerent levels and tasks. 

I imagine a cauldron as far larger than an actor in terms of both memory and computational activity. In 
general, 1 envision a cauldron to contain on tlie order of one hundred rules and perhaps tliree to six times that 
many assertions which arc not rules. ("Rule" here refers to any sort of "active" assertion.) This number -- an 
oir the cuir calculation based on when the current implementation becomes unwieldy in terms of efficiency or 
accessibility to debugging -- refers to each cauldron's uldmafcsv/.c, rather than to the si/.e of die kernel which 
creates it. 

Computation on a cauldron-level resembles the actor model, with each cauldron as a message passing 
entity, but most of the real computation in a cauldrons based reasoner goes on inside of die individual 
cauldrons, in an environment of rules and assertions. This distinction catches on a commonly recognized flaw 
in die scientific community metaphor, a recent explication of the actor model. The scientific community docs 
not produce theories, sciemists Jo. Thus, if the "actore" are scientists, each scientist must have enough 
compuuuional power (in terms of knowledge as well as cycles) to generate a theory. ITie theory does not 
necessarily have to be good, but it must have the internal structure, in terms of dependencies and motivations, 
of a complete theory. The dimcully is that on the compuUitional side of the scientific community metaphor, 
there is no chunk of computational mechanism sufficiently large to serve as a scientist.' I view the cauldron as 
a "chunk of mechanism" large enough to both develop conclusions and to moiivate tliose conclusions. Ihe 
typical actor \s not sufficiently complex to satisfy tliis requirement. 

For insuince. in the blocks world example of Section 1.3, a subcauldron issues a need for some relation 
to exist, and explains tliat need. If a cauldron needs to choose between the multiple needs of its children, this 
explanatory justification is necessary to making correct judgements. Hut the subcauldrons can only provide 
this information if they arc complex enough to realize that: 

Prerequisite = => Action becomes possible = => Goal may be achieved 
The typical actor or sprite or rule is much too simple and small to possess such complex knowledge. Ihis 



8. The flaws described here are not flaws with the actor model, but with the characterization of a community 
of simple actors as a scientific community. The actor mechanism -- like the lambda calculus - provides a 
battery of powerful terms and concepts for describing compuuition. Kor many purposes, it is useful u. 
describe the rules in a given cauldron as simple actors: but it is not similariy useful to describe such simple 
rules or actors as scientists in a research community. 
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suggests that the sprite or actor level is not tfic right level of abstraction for talking about intelligent 
interactions of concurrent agents. If multiple agents are to interact intelligently, they have to be complex 
enough to recognize WHY they need to interact. In simpler schemes, like schcmas[l)rescher86) or 
c-lincs [Minsky77], Uicre is no claim to "intelligent interaction" so that tliis problem does not arise. Hut when 
the agents of a model are deigned to be even slightly more complex, die problem of knowing "why" 
communication is necessary becomes critical. 

Another important dilTerence between actor schemes and cauldrons is that cauldrons-based reasoners 
have a more explicit control structure than typical actor-based systems. The application of a cauldrons-based 
reasoner to a problem is far more directed than the application of an actors-based system to die same 
problem. In a cauldrons-based reasoner. there is a clear notion of computational hierarchy, encompassing the 
relations between controllers and controlled. A cauldron is typically invoked by an executive rather than by a 
co-worker. 



Kornfeld's Kthcr [Kornfeld82J is a system very similar in design to cauldrons; it is a problem solving 
language which distributes compuUition over a collection of compuUitional entities. In either, tliose entities 
are viewpoints,^ while in my language, tliose entities are cauldrons. 

While there are technical details of tlic lather implementation that I have doubts about, such as its 
monotonicity or its separation of sprites (rules) and assertions, there are only two explicit diirerences between 
Hther and cauldrons which I would argue for:'° one of these is a dilTerence of intent; another is what I 
perceive as a serious problem with Htlicr's approach. 

Cauldrons evolved from a collection of ideas about how the mind might work into a set of abstractions 
for building networks of "little minds" which perform reasoning tasks. As a result of this evolution, neither 
my implemcntaUon nor my theories contain notions like "computatit)nal power," since I cannot envison 
(possibly my own failing) a theory of mind which would support such a mechanism. Hewitt and Kornfeld in 



9. Hther activities are the way that computation is divided, but viewpoints are the way knowial^c is 
apportioned. Activities are used to parcel computational power, a mechanism I have chosen not to use, while 
viewpoints are used to parcel and restrict knowledge, which is tlie intent of cauldrons. 

10. This means they were conscious decisions made in the development of both theories and 
implementation. 
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[llcwittSO] define a dilTercnce between their approach, "the scientific society" approach, and Minsky's 
"society of the mind/cognitive modeling" approach. The difference in intent between my work and HUicr is 
essentially the s<ime. 

The one aspect of HUier which I have grave doubts about is the way in which programs in Hther arc 
written. The standard way to solve a problem in Hther is to write a program which combines LISP code 
calling |{ther primitives and lather code c.illing I.ISK Kornfeld stresses, in fact, that "Lisp should not be 
considered an 'escape mechanism' in Llther." My prime misgiving about this is that if a program must 
understand or be able to modify itself, having this mix of Lisp and hither will make self modification very 
dilllculL'' This failing is demonstrated in lather's separation of rules (sprites) and assertions: hther sprites are 
written in I'ther (a Lisp-like language), while Lther assertions are written in the language of the domain, with 
sprites only triggering off of assertions, not ofT of other sprites. While Llther is an excellent language for 
writing programs to solve any particular problem, when programs must modify either themselves or their 
approach to a problem, the difficulties of understanding the LISP code, and even worse. Uie interaction or the 
LISP and Hther code, will be hard to overcome. 



Davis' nicta-rulcs [I)avis79], initiated much of my thought about strategies for restricting computations. 
The essence of meta-rules -- of having heuristics for heuristic selection -- is important in any situation where 
decisions about about the relevance of knowledge or methodologies are made. A range of issues that I have 
only tentatively explored revolves around this- precisely, how do you choose which techniques to apply in 
solving a particular problem. It is likely that I3oyle's [DoyleSOj ideas about policy and intention will be an 
excellent suuting point for systems which choose between multiple methods or approaches. The nccJ 
mechanism in the example in Uic introduction is a first step in Uiat direction. Another issue of interest is the 
means by which such me ta- heuristics are acquired. (Lenat's recent work into hcuretics ILenat82J explores 
tlieories, models, and heuristics for thinking about heuristics). 

An issue which mcta-rulcs docs not address is the issue of maintaining multiple instantiations of a 
reasoning program, where each uses different techniques and different knowledge. Davis's more recent work 



11. While the implementation of a problem solving language may best be done in LISP (or some other 
traditional language), tlie inhomogeneity of mixing LISP and a problem solving language often cripples its 
refiexive flexibility, possibly leading it into the pitfall of "skill acquisition by DEFUN". 
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with Smith on contract-nets [DavisSla], docs address this issue, but their approach differs from mine in tlie 
same way the as KUicr's-- it seeks interesting and useful ways of distributing computation, rather than finding 
and testing Uieorics which explain how the mind does Uiings. Contract nets do capture the important concept 
of liislribuicd functionaliiy, a contract is an arrangement between different processes which arc perfonning 
dilTerent tasks with different expertise. i-urUier, Davis' latest work on multi-agent planning [DavisHlbj 
considers the difUculties of multiple agents dealing with limited or unique resources in a coordinated way. 
These are issues which need far closer examination if distributed mechanisms are to be applied to real-world 
interactive problems. 



Ihe I learsay systems [I csser??) arc architecturally similar to cauldrons. Cauldrons implement layers of 
abstraction in a reasoning program which can be compared to the levels oUiypoihcsis blackboards in Hearsay. 
However, the locus of compulation in cauldrons is different from that in I learsay. In I learsay, compuUition is 
pcrfonned by knowledge sources (KS's) which generate hypotheses on a given level of abstraction by 
examining adjacent levels. In cauldrons, tlic computation is centered in the cauldron rather than in the 
interaction between cauldrons. A cauldron, unlike a blackboard, computes as well as collects. 

Within each cauldron, generated hypotheses and plans are debugged and criticized by local procedures 
and knowledge, before being propagated up or down the abstraction hierarchy. This serves to hamper tiie 
propagation of bogus hypotheses between "blackboard levels". Additionally, the activities at any one level of 
the cauldron hierarchy arc not homogeneous. The subcauldrons of a given cauldron apply a range of 
expertise and techniques to its subproblems or sublevels. Within a cauldron network, a range of "pockets of 
expertise" are dynamically created and destroyed as the system deals with new information or new 
hypoUicscs. 



Many theories of distributed computation work with even smaller agents than actors. Schemes like the 
semantic network machines, constraints, or relaxation algorithms work with an agent si/c far smaller than 
cauldrons. The internal workings of a cauldron, with its interacting rules and assertions, may well be of 
comparable "grain size" to schemes like constraints or relaxation algorithms. It is on this level, and not in 
higher level parallelism, Uiat I suspect the important cfHciency gains will be made. I view higher level 
schemes like cauldrons as mechanisms for improving abstractions; lower level techniques like constraint 
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propagation or marker passing 1 view as mctiiods for iinproving efficiency/' 

2.3 Static Cauldrons: A Note 

Hie notion of cauldrons and frames described above arose from eaiiier work in learning and reasoning 
in highly parallel semantic networks. This work was begun in 1979 under Chuck Rieger at the University of 
Maryland and continued at MIT in 1980 and 1981. This work, unreported, began with a subset of Scott 
Kihlman's NKIL [I'ahlman791 {a highly parallel semantic network implementation) and extended the 
'existence bit' of NKII. to an 'existence word' for xlescribing multiple belief or reasoning contexts. It then 
provided an 'implication link' for connecting statements (representational links in the semantic network). 
Ihesc implication links also had 'existence words' which affected the existence words diey were able to 
propogate. 

The suitic network so defined could entertain several states at once and each state (each bit of the 
allocated existence words) was called a 'cauldron.' As existence biLs nicked to and fro throughout the 
network, the activity of the program proceeded along many lines or through many paUis at once. The 
implementation of this network never got past a primitive simulation suige and eventually became (with the 
inlluence of other ideas at Mil) the set of ideas described here. 

The implication links of the suitic implementation were used to activate patterns of rules" and 
'assertions' in die network, and became Uic notion of frames (and of goal nodes) in the current 
implementation. One novel component of this activation notion was a selective version of the automatic 
'frame creation' described at the end of the last chapter. New patterns of activation could be defined by 
capturing current patterns of activation, in particular by tracking the 'dependencies' for the current pattern of 
activation. All die activated nodes in die network, and the nodes which activated dicm, were used to specify a 
pattern of reactivation which could become a new 'frame' (in die parlance of die current implementation). 
Since reasoning was divided into levels by cauldrons, by constraining diis recording to a single cauldron (a 
single bit in die propogatcd 'existence word') only immediately 'relevant' nodes would be recorded. 

in retrospect (from 1986). diosc ideas seem worth returning to. In fact, promising systems like API. 



12. lUit of course, improving efficiency makes it possible to think about reasoning technologies which could 
never be seriously considered before. 
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[liIcll(H;h86| seem to echo many of the ideas of tliis implemeiitaiion. Kiirthcrmore. Agrc's work on routine 
behaviour [Agre85] adopts the notion of inverting dependencies into activation patterns, though witii a far 
more complete implementation. 
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3. Representation tis Restriction 

I'his section takes a tclcological view of representation systems, working from tiie insistence that 
knowing what is useful is just as important as knowing what is true. A representation system docs not merely 
provide a structure for making valid assumptions (defaults), it also provides a structure for determining what 
knowledge might be useful to a certain goal, in a certain situation, or for a particular inference. 

Ihe question of what knowledge is useful becomes relevant to the A I reseiircher only when one can 
choose what information ones prograiTi looks at when making inferences; precisely, when one has a 
mechanism for restrictmg consideration. Assertion based inference mechanisms without explicit control of 
focus and reference cannot offer a framework for establishing relevance-based representation schemes. 

3. 1 Knowledge Representation 

This section describes a representation scheme working from the intuition that any knowledge 
representation is a paradigm for restriction of consideration, faking this intuition, the solution of the 
representation problem becomes the space of solutions to the restriction problem. This gives a knowledge 
representation the clear design goal orjcjining knuwlcc/gc necessary Jar a particular performance. This frame 
implementation is a mechanism for defining chunks of knowledge (collections of "active" rules and "inactive" 
sUitemcnts) which may be mixed and merged to create tailored reasoning contexts. 

The active and procedural nature of this tiiilored knowledge allows "meaning" to become an 
interpretation^^ of the computational context (the cauldron and die "chunks" of knowledge which define it) 
rather dian any absolute definition. Making the knowledge an active part of the reasoning process lends 
power to these chunks of knowledge, allowing the knowledge representation to implement an epistemology. 
radicr dian merely fulfilling one. 



13. In a very real sense of "interpret." 
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'he basic unit of tlic representation is the frame, an assertion consisting of tiirce parts: 

o A tag, which is an identifier for tiie frame. 

o A set of inclusions, each of which is tiie (ug of ant)ther frame in the same 
cauldron. A frame is said to "virtually include" tlie frames attached to its 
inclusions. 

o A set ()( foal u res, each of which is cither a frame or an arbitrary object in the 
language of the problem solver. 



"here are three basic operations on a frame: 



o I'cature alteration. The addition or removal of an object (or frame) to or from 
the features of the fraine. 

o Inclusion alteration. The addition or removal of a frame-tag to or from the 
inclusions of the frame. 

o l-rame Invocation. The "activation" of the frame into a problem solving 
context (cauldron). When a frame is "activated" into a cauldron, Ms features arc 
asserted into the cauldron and each of its inclusions arc activated, recursively, into 
the same cauldron. 



A frame is defined as a set of arbitrary assertions (features) which may include, virtually, the assertions 
of any collection of other frames. Spreading activation through these inclusions then determines the set of 
assertions which are eventually added to the cauldron a frame is invoked into. Vhcsc features {v^h'ich iTiay be 
rules, censors, arbitrary statements, or other frames) interact with other similarly activated features in the 
cauldron to pcrfonn tasks, complete inferences, or organize existing knowledge into new structures. The 
current implementation of this system has the bug that features are given precedence over inclusions by the 
mechanism of asserting the contents of inclusions before the features, allowing the immediate features to 
"clobber" elements of the inclusions. I'he exact problem is that since there is no implicit dependency 
maintenance accompanying non-monotonic modifications to the cauldron, "clobbering" does not always have 
tiie complete and correct cfFccL One way that this has been patched is to define rules -- in some particuhir 
reasoning contexts -- which keep track of the addition and deletion of assertions in a cauldron. 

A key feature of this implementation is that it leaves all epistemological issues, such as the meanings of 
A-Kind-Of or Part-Of, to be implemented in tlie representation rather than being dejincil by Uic 
representation. It provides only a facility for defining chunks of knowledge to be applied and used by a 
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program, leaving all issues of meaning and cpistemology to interpretive structures implemented within the 
facility. 

For inst;mcc, A-Kind-Of could be implemented as below:'* 

Frame 

Name: Class 
Inclusions: None 
Features : 

If {class HAS-OUALITY CLASS} 
{inskince IS-A-KIND-OF class) 
Then : 
If {class some- rcia/ ion sonic-qua/i/y} 

HOT {instance some-relation another- quality') 

Then : 

{instance some-relation some-quality) 

so tliat if there is a frame for carburetor: 

Frame 

Name : Carburetor 
Inclusions: None 
Features : 

{Carburetor HAS-COLOR Black} 

{Carburetor HAS-PART Foobar-Val ve-Part} 



14. ihc "code" given here is a pretty printed form of the actual assertions and rules in the current 
implementation. A frame has its parts clearly labeled; An IF form asserts those assertions after its THEN for 
each set of assertions matching the patterns before the THEN. Italicized words correspond to variables which 
will match anything and bold italicized variables refer to variables which have already been matched (and 
thus have values constrained by their earlier appearance). The first piece of code implements inheriUincc of 
defaults along AKO links. The frame CLASS contains a rule which says: 

"If an instance is a kind of some class class, and c7</.v.v has a relation relation to some value which 
tiie instance docs not explicitly have, then die instance has the same relation to the same value." 
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it is Llicn possible to construct a fnunc for carburetor class: 

Frame 

Name : Carburetor-class 
Inclusions: Carburetor, Class 
Features: 

{Carburetor HAS-QUALITY Class} 



and for a particular carburetor: 

Frame 

Name : Carburetor- 1 
Inclusions: Carburetor-class 
Features : 

{Carburetor-1 AKO Carburetor} 

{Carburetor-1 HAS-COLOR Silver} 

which will have a Foobar-Val ve-Part and would be black if it weren't clearly silver. The derinition of 
Carburetor-class could also complain if some of the features of a given carburetor were undefined or 
inconsistent, bor instance, if we could expand the definition of Carburetor-class to be: 



Frame 

Name: Carburetor-class 
Inclusions: C arburetor. Class 
Features : 

{Carburetor HAS-QUALITY Class} 

If [instance AKO Carburetor} 
{instance HAS-COLOR Black} 
Then: 
{instance HAS-AGE Old} 
If {instance HAS-AGE New} 
Then: 
Error{A Carburetors age doesn't match its appearance.} 

so that an "error report" would be generated (and presumably noticed) if a carburetors apparent condition 
did not match its given age. 
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Wc can also define variant forms of inheriumcc from classes or between insUmces (for there is mucii 
beyond AKO). For example, consider this definition of HAS-PART: 



Frame 

Name : Part 
Inclusions: None 
Features : 

If {part HAS-OUALITY PART} 
{supcr-parl HAS-PART part) 
{part HAS-PART sub-part) 
Then: 
{super-part HAS-PART sub-part) 

If {whole HAS-PART part) 
Then : 
{part IS-CONTAINED-IN whole) 



Using the definition of part, it is possible to construct a frame for carburetor-part: 



Frame 

Name: Carburetor-part 
Inclusions: Carburetor-class, Part 

Features : 

{Carburetor HAS-QUALITY Part} 



and for Carburetor- 1: 

Frame 

Name: Carburetor- 1 
Inclusions: Carburetor-part 
Features : 

{Carburetor-1 AKO Carburetor} 
{Carburetor-1 HAS-COLOR Silver} 
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such tliat wc may define this frame for Ivngine: 

Frame 

Name : Engine 

Inclusions: Class, Carburetor- 1 

Features : 

{Engine HAS-COLOR Blue} 
{Engine HAS-PART Carburetor-1} 



which has a number of interesting features, including possession of a Foobar-Val ve-Part inherited from 
tlie carburetor via Carburetor-1. liut this inheritance is Jilfcrcd inheritance since other features of the 
carburetor, such as its color, are not inherited. This definition of HAS-PART is certainly weak and 
incomplete, but its definition reveals two powerful capabilities of this approach: 

Arbitrary defaulting or inheritance mechanisms may be defined explicitly and 
extensibly. These defaulting mechanisms need not merely default by inheriting 
through some hierarchy or hetcrarchy. but can refer to any elements of the current 
reasoning context. 

'fhe semantics of a representation -- the way attributes arc defiuilted and 
constrained - may be globally or locally redefined for a given reasoning context or 
a collection of reasoning contexts sharing a common frame. 

If the language t)f the problem solver -- in which the contents of frames are written - has assertions which can 
override or inhibit other assertions, (i.e. is non-monotonic) it becomes possible to wholly replace a definition 
of AKO or HAS-PART for a given frame. This pcnnits the meaning of AKO or HAS-PART to vary depending 
on context, so that being A-Kind-Of "hacker" may use a very difTerent interpretation of A-Kind-Of than 
being A-Kind-Of "heavy object".''' 



15. Ilic introspective realization that hearing "Clyde is an elephant" immediately conveys a great deal of 
information about Clyde suggests that AKO is indeed special in some deep way. lUit the description "Clyde 
is elephant-shaped" invokes a large number of facts just as quickly, but leaves behind, y///cr5, a great deal of 
non-shape infonnation. Our recognition of this sort of simple analogical description (Clyde is shaped like ^m 
elephant) seem just as quick and natural as our recognition of insuince-class descriptions, suggesting that 
AKO is not especially primordial. 
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3.2 Representation as Restriction: Other Approaches 

The approach of implementing representational mechanisms like AKO in a general declarative 
language is in essence the same approach presented in [Mayes??) and [NilssonSOj. Both of these presenuitions 
describe skeletal frame implementations implemented in KOPC. In [Hayes??] Hayes further recognizes the 
utility oi'JiliercJ inhcrituncc - described above -- as seeing as: for instance, seeing Thomas Jefferson as a 
scientist, rather than as a politician or as a slaveowner. Hut while simply embedding IKI . or KRI . in h'OPC is 
interesting in itself, the result provides little of die real functionality in these languages. An l-'KI. in lOPC 
may tell you what is true,^^ but it does little in d)e direction of telling you what is useful, liccausc cauldrons 
implement a notion of /rxv// knowledge, the measure of a rule or assertion's relcv;incc suddenly gains meaning 
and importance. The frame implementation presented above organizes knowledge into contours of 
relevance," fuH'iHing the requirement that a representation classify what is "useful" with the same facility that 
it classifies what is "true". 

The chunking of knowledge into contours of relevance bears similarity to the use of the theory construct 
of Weyrauch's KOI. [Weyrauch?8J and its close descendant SDI. (Structure Description i,anguagc) [DoyleSO]. 
lioth of these systems implement tlic concepts of structure and model defined for first order logic. A theory 
in KOI or SDL consists of three elemcnLs: a language defining the syntax of statements in the tlicory; a set of 
axioms which can generate valid statements in the theory; and a simulation structure which connects 
statements in tlie dieory to some process which allows the sUitements to be inteipreted and simplified. As 
with Uie frames containing a definition of AKO above, a dieory is a collection of statements accompanied by a 
description of their syntax and semantics. 



,o I J 



The theory of KOL or SDL and tlic frame of my representation both provide mechanisms for chunking 
knowledge into contours of relevance, a feature lacking in Hayes and Nilssons examples. But all diese 
schemes define only incomplete chunks of knowledge, and any reasoning process will consist of the 
interaction and intermixing of many such chunks. The mechanisms by which this intermixing is performed 



16. Barring the monotonicity problems which keep KOPC distinguishing what was was once true from what 
is true. Doyle [DoyleSO] discusses a flaw in default handling, \hQ family resemblance problem, which arises 
from Uiis monotonicity. 

1?. The simulation structure is used to give a theory meaning, a link between the theory as a representation 
and that which it is representing. In order for the sentence "s = l/2*a*tt2" to have meaning, its elemenis 
{s,a.t,2.1/2,*,t,= } must be attached to eiUicr ariUimetic primitives or better, to a Uieory of equations in the 
reals. 
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arc as important as the organization of tiic cluinics tiicmsolvcs. 

In FOI., die primary mechanism for tlicory interaction is rcjicciiun. ilcncction allows suitcments in one 
tlieory to talk about theoremhood in another theory. Thus, if a meta-theory iVl talks about some theory \\ 
and we wish to prove some theorem in T, we may be able to immedi.itely generate tlie theory by perfonning 
some simple transformation in M. In l-OL, reflection is invoked via the REFLECT command, which applies 
some principle from the metii-tlieory of the current theory to a set of statements in tJie current theory. One 
shortcoming with this mechanism is that tliough a theory can refer to its meui-theory, tlie meta-theory cannot 
refer to the component tlieories it describes. Kor insLince, while a theory of peano aritlimetic may rcdcct to 
the theory of reals which contains a summary of it, the same theory of reals cannot refer to peano arithmetic 
to justify new principles or axioms. 

By contrast, in a cauldron hierarchy, higher levels invoke lower level activities t{) satisfy their plans and 
goals in addition to resolving conflicts and difllculties at the behest of lower levels. Thus the link between an 
active theory (cauldron) and the active theory which uses that theory (its parent) works both ways. 

Doyle's SDI. replaces reflection with a mechanism allowing semantic attachment to other theories as 
well as to implementation primitives. Thus, a theory can refer to another theory. Attachment to theories is 
used in concert with two other mechanisms, virtual copies iind typed parts. 

Virtual copies are a mechanism for inheriting assertions between theories. If a theory I copies a theory C', all 
the statements of C become included in I. This is identical to the frame inclusion mechanism used with 
cauldrv)ns. Class instantiation is performed using virtual copies, by copying the theory of die class into the 
theory of tlie instance, and then attaching a constant in the instance to the global name of the theory of the 
class. In a cauldrons-based frame representation, the mechanism for instantiation is similar, but with the 
latter step, attachment, performed by explicit mles and axioms implementing some instantiation mechanism. 
Thus certain objects or techniques may perform this attachment in a completely different manner. 

Typed parts arc similar to virtual copies in tliat they copy another dieory into the current theory. ITie 
difference is that the constants of the copied theory are replaced by pathnames, allowing a theory to have 
several distinct parts which instantiate the same theory. 1 argue that this typed part mechanism is misguided 
in haphazardly colliding sub-theories within Uieir super theory. The point here is the subtle but important 
difference between referral and containment. A Uieory of real numbers may refer to a dieory of peano 
arithmetic, but it will not contain diat dieory. The difference is diat referenced sub-theories arc instantiated 
separately from die dieories which use diem for justification or motivation. Cauldrons serve as a mechanism 
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for instantiation which allows the separate insumtiation of connected theories. A cauldron reasoning about a 
bicycle will generally invoke another cauldron to reason about the ball bearings in one of its wheels. 

Agre and Chapman [Agrc&ChapmanS.lJ replace Doyle's typed part mechanism with a mechanism called 
virtual inclusion. Virtual inclusion is essentially an extension of Doyle's virtual copy mechanism which allov/s 
tlic axioms of a copied theory lo have their elements renamed to references in the thecMy being copied into. 
As with the typed part mechanism, tliis violates the modularity of knowledge -- the contours of releviuice - 
wh.ich the theory construct provides. 



Since FOi. is put forth as an interactive proof checker, there is little chance to "sec it in action" with 
traditional A! Uisks involving planning or reasoned deliberation. Weyrauch does not present cases where 
KOI. chooses to use a particular theory, or decides to apply one theory in favor on another. fOi. also avoids 
tlic problems of mixing theories (outside of the meta-theory attachments outlined above) with one and other 
by not attem.pting to implement any sort of inclusion or theory-copying mechanism. As described above. 
SDI. attempts to broach these issues with a virtual copy mechanism, but needs to push the mechanism too 
far^^ due to tlie lack, I argue, of a way to explicitly use one theory from another theory without violating the 
principles of abstraction and modularity which separate theories from each other. 

Regardless, given these tools for theory interaction, SDL attempts to attack more general Al issues, but 
its presentation in [DoyleSOj is weak because Doyle uses essentially the same examples which Weyrauch 
presented in lWeyrauch78|. While Doyle speaks of reasoning about plans and sequences of actions (where 
actions are presumably attached to either other plan-theories or physical or mental acts), he never presents 
working examples which deuiil that reasoning in action. This may be because Doyle's definition of "mental 
acts" is no clearer than his specification of "physical acts," due to the absence of any "attention mechanism" 
with which to perform mental acts. Doyle does make a large number of important points about reasoning 
about reasoning, approaching such issues as how to decide which theory to deliberate with, how to modify a 
theory with respect to its success or failure, or whether to bother deliberating at all. Unfortunately. Doyle 
fails to ground tJiis reasoning about reasoning to any real pieces of reasoning technology. 



18. This is a common pitfall of rcprescntatit)n systems. The AKO link in h'RL [Roberts??] has the identical 
failure mode., inheriting all sorts of things and being used for a range of relations it had no business trying tt) 
express. 
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hOL and Sl)l. arc far more cleanly and precisely defined Llian cauldrons, but they leave enough 
questions unanswered to beg their sufficiency. Hventually, 1 can imagine cauldrons maturing into something 
as precisely defined as FOL, but currently tlic Issues which cauldrons attempts to deal with, such as explicit 
attention control or "contours of relevance," arc still too imprecise to be clearly and formally defined. 

h'rom the stiindpoint of 1986, we can note the development of SlMlliRI- [l'illman831 i>s a version of 
I "Ol . with more extensive multiple context reasoning facilities. We also see the extensive work of Gcnescrcth 
and his colleagues [Genesereth82] as following die lines of explicitly describing how assertions and statements 
should be inierepreted and implemented. 

J.3 Frames and K- Lines 

Minsky's Society of the Mind offers a number of attractive mechanisms for restricting the computation 
involved in resolving of any particular task. The Society of tlie Mind offers a view of the mind as a collection 
ofcompuuitionally simple agents communicating by channels called c-////cs[Minsky77]. The composite of all 
the agents states, expressed as tlie states of their c-lines, defines the S(x:iety's, and hence the mind's, "menuU 
state." Similarly, a partial nwntal stale is the state of a subset of the minds c-line communication chaimels. 

In [Minsky79j, Minsky proposes tliat the mechanism of memory is one of reactivating partial menial 
states. When recalling an event, a fact, or a technique, a set of agents and c-lines are "activated" to interact 
with the current mental state. Minsky proposes that a partial mental state is stored by connecting the 
elements of the state (the c-linc connections) to a goal-node by a set of k-lines. This connection is arranged so 
that if the goal-node is ever activated, the "activation" propagates through the k-lincs to reactivate a stoicd 
partial mental state. A powerful addition to diis enables k-lincs to atUich goal-nodes to odicr goal-nodes as 
well as to individual c-lines, thus creating a network which reficcts a "hierarchy of activation". This hierarchy 
serves as a simple abstraction mechanism which can be expanded into representations for knowledge which 
may be logical, frame-like, or prcKcdural. 

K-Lincs arc constructed by goal-satisfaction; when a goal is satisfied, the the agents active on us 
satisfaction are recorded as an activation pattern. The links of this activation pattern — from goal to agent -■- 
are called k-lines. When a partial stiUe of agents is reactivated dirough stored k-lines, the activation brings lo 
bear the same agents, attitudes, and knowledge that were previously available when the goal was satisfied 
One way of illustrating this idea is with the following image: 

Imagine a large workshop with a wide variety ofdijferent tools easily available. The task of a worknhin \ 
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to fix a broken bicycle, which is brought in and placed on a workbench draped with cloth. The workman 
begins working on the bicycle, using tools from around the workroom— he is not too experienced with 
bicycle repair, so much of his work is trial and error, perhaps mixed the general ideas and principles 
concerning "the right way to do things. " 

If a tools fits and does its job. it is dropped on the clot draped table. 

If it fads to work it is tossed away. 

Finally, the bicycle is repaired (the workman can notice this). He takes it down, puts it away, and picks up 
the tool-covered cloth on the worktable. wrapping it into a bundle. He tags this bundle with a ribbon 
nmked "UK ' YCl. h' R i.PA IR " and places it on a shelf The next time a bicycle needs repair, this bundle is 
unfolded onto the work table. All the tools are tehre. cmd work proceeds, without the neccessity for trial 
and error as before. 

If the tools are actually magic and intelligent screwdrivers, wrenches, etc: i.e. agents which work by 
themselves and interact to repair the bicycle, then the workman becomes part of the tools, and all that need 
be done is to dump the bundle of "tools" onto the table with the bicycle. 

The frames implementation described above derives much of its inspiratit)n from the intuition of "knowledge 
as reactivation" which k-lines provides. I have simply replaced parts of the c-linc network and hierarchy by 
the arbitrary objecLs of a problem solving language (assertions, rules, etc). The generally hierarchical structure 
of a network of cauldrons parallels the c-linc control hierarchy '^ described in [Minsky77]. The most 
prominent feature of this is diat it allows an analogue to Minsky's Icvcl-band-principlc, which confines specific 
"learning events"^" to a tight range of levels of the abstraction hierarchy; thus learning a new technique for 
doing proofs doesn't generally affect the way one holds a pencil. As in any sort of programming, preserving 
layei-s of abstraction makes debugging (as well as understanding!) far easier. Cauldrons implement these 
"layers of abstraction" in a declarative programming language. 

Minsky calls the elements which trigger the k-lincs "goal nodes," a regrettable misnomer, for while tlicy 
have a good deal to do with reacting to explicit goals, they are also a powerful mechanism for structuring 



19. This was Uie "BUILDER-WRECKER" hierarchy. In the cauldron system, each level of abstraction 
influences and "inspires" (as opposed to "controls") the level below it. 

20. Precisely, k-line attachments. 
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knowledge of the worid. Hence, having Uikcn the "activation" parts of the k-lincs theory and lumping them 
into ilie frame mechanism described above, I simplify the notion of goal-node to be something which is 
triggered by the presence of a particular class of goals. 

I retiiin the term goal-node because it fits so well, defining a structure which ties together the frames 
relevant to achieving a particular goal. The functionality of the goal-nodes described here is lar simpler than 
the functionality of the goal-nodes described in [Minsky79]. My goal-nodes do not implement memory, they 
implement the application of memory to a problem. 

The goal-node used with cauldrons consists of two parts: a trigger pattern and a set of associated franws. 
When a goal appears which fires olTthc trigger-pattern, a cauldron is sLirted trying to achieve that goal, and 
the ass(Kiatcd frames of the goal-node are "activated" into the cauldron. The goal-node thus serves as the 
mechanism by which a compuUition is begun and its direction and area of consideration defmed. 

Kor instance, in tlie blocks-world, the goal-node for making one block support another looks like: 

Goal -node 

Trigger-pattern: {lUOCKA Supports ni.OCKA) 
Act! vat ed- frames : 

DEFAULT-MAKH'SUPPORT-TECHNIQUE ; How to do it. 

BLOCK A ; Details of one block. 

niAKKB ; Details of the other. 

HLOCK-PROTLCTIONS ; Censors. 

The goal node triggers chunks of knowledge relevant to a given problem. I'his triggered knowledge might 
range from actual techniques to accuinulated censors to knowledge about the particular blocks involved. 

Goal-nodes serve to define a reasoning context for a particular task. 'I'his context contains knowledge 
about the deuiils of the situation (for instance traits of individual blocks), general constraints of the larger 
current reasoning context (for instance bl(x:ks which are protected and untouchable), as well as knowledge 
about how to achieve ones goals. 
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4. Conclusions 

I'his paper has described and demonstrated a collection of abstraction mechnanisms for distributed 
reasoning systems. In conclusion, I will outline tlie approach which motivated tiiesc mechanisms and then 
criticize both the approach and the mechanisms it engendered. 

4, 1 Philosophy of Minds 

Cauldrons iuc an implementation of distributed problem solving developed in parallel with an emerging 
theory of distributed cognition. I have approached the issue of distributed computation in an unusual way; 
instead of starting with multiple processes and then figuring out how to distribute computation among them 
to perform tasks iti an "intelligent" or "efficient" manner, I begin by looking at mechanisms of diought and 
then use the technology of distributed processing to model those mechanisms. The difference between these 
two approaches is one of intent: 1 am interested in how minds work, and am using computation as a 
touchstone for my theories. Instead of thinking in terms of a "distributed theory of compuUition," I am trying 
to begin the definition of a distributed tlieory of mind. 

This tlieory views the mind as a collection of interacting computational processes which generate the 
surface phenomenon of rational and irrational tJiought. These prwesses have the following features: 

o They are restricted. 

o They are dynaniically created. 

o They communicate with one and other. 

Restriction of processes is a requirement that no process have a global viewpoint. A given "piece of 
knowledge" interacts only with diosc pieces of knowledge local to it. Pieces of knowledge may react to or 
produce other pieces of knowledge, but they may only react to or immmediatcly effect the knowledge 
involved in the same process. I'his notion of restricted consideration is fundamental to die definition of a 
"prtKCSs". 

Artifical Intelligence is often criticized for succeeding only by restricting the domain of reasoning to a single 
"micro-world" or "expert-domain"; the flaw in these criticisms is the assumption tliat the processes of human 
reasoning are not similarly constrained. Human beings restrict tlie domains of tlieir problem solving in much 
the same manner as A I researchers restrict die domains of their programs problem solving. When the mind is 
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examining a play of Shakespeare, it is not at the same time considering some aspect of the integral of natural 
log. This restriction of consideration plays a critical role in the problem solving process. I he restriction of 
reasoning processes provides the technology of contexts of consideration as well as a closed world assumption 
for die reflexive examination of those processes. 

I'hese restricted reasoning processes are dynamically constructed and discarded, at need, as the reasoncr 
encounters new problems, new situations or new distractions. The process structure tliis creates is not a fixed 
piece of reasoning hardware, but constantly changes as reasoning proceeds. This notion of restricted mental 
pr(x:esses appeals to folk -psychological notions of "focus" or "context". 

It is in the dynamic creation of these processes that large pieces of knowledge arc mobilized into the pursuit of 
tasks and goals. Thus the constraint of restriction is implemented in this mobilization, making sure that the 
pieces of knowledge and procedure present in a process are precisely relevant to its function. An activity is 
thus instantiated with most of the knowledge, both procedural and declarative, ncccessary to its performance. 

Communication allows one prtKCSs to influence the events in another process. The constraint of 
restriction demands that this communication be limited, and we accede to this by allowing communication 
only through explicit channels and generally using tliosc channels solely for the communication of control 
information.'* 

The greatest failing of any restriction scheme is the unexpected- if a restricted reasoning process runs into 
un.brseen interference, unsatisfied prerequisites, or internal inconsistencies, it is generally unable to act 
because of its narrow focus. Communication allows a recourse from tliese situations, permitting a process to 
request that some other process remove interferences, satisfy prercquistes or even debug the troubled process! 
These requests may be either resolved directly by an existing process or may insUintiate a new process with 
the expertise for resolving the specific quandry. 



The characterization of reasoning processes described above is reflected in the abstractions this paper 
has presented. ITic notion of restriction is implemented by the cauldron, as a restricted arena for deduction 
and inference. The dynamic creation of reasoning processes is embodied in the ability of a cauldron to create 



21. Requests and replies as opposed to techniques or factual deuiils. (A reply may of course be a "factual" 
detiiil, but we constrain replies of this nature to be "expected" in the sense that some mechanism exists within 
the process for handling tliem.) 
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other cauldrons, and particularly, in tiic goal-node mcciianism. And finally, tlie necessity of communication 
between reasoning processes is provided by the frame mechanism, permitting cauldrons to communicate and 
share information between tiiemselves. This communication is not merely between concurrent processes, but 
between processes separated by time, speaking tlirough the channels of memory. 

4.2 Failings and Futures 

This research, like any research in a new area, has obvious failings. Primarily, these failings lie in the 
realm of unanswered questions and unmotivated assumptions. This section will attempt -- in brief- to both 
motivate some basic assumptions and to describe future research on the many questions that still remain. 

Why does on« even want parallelism? 

Parallelism is a way of keeping things small. Having conventions for making parts of an Al system 
separate and parallel (with only a few clearly defined dependencies between them) provides "fissure points" 
for making big problems smaller. An earlier vereion of this paper had a whole section motivating -- with folk 
psychological arguments - such mechanisms in the mind. Its main argument evolved around the inability of 
the human mind to function well on problems which demanded large arbitrarily connected collections of 
knowledge. This observation, coupled with observations of Al programs which seemed to fiounder in search 
problems, led to the principles of the previous section. 

Is it "easier" to prograni in cauldrons than in other languages? 

Sadly, no- the organization of programs and the extension of programs already written seems easier in 
cauldrons tlian in other declarative languages. I'his is possible because one can refer to whole approaches ^md 
mechanisms as single chunks of rules or assertions. Unfortunately, the language in which one writes these 
chunks -- a sort of poor man's AMORO -- is clumsy to use. The language has no IMS or arbiii.uion 
mechanism and as a result over half of ones code is making sure that the other half doesn't fire olT 
unexpectedly and cleans up after itself when done. 



Shouldn't there be more complex interactions between cauldrons? 
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I'his research has failed to broach this question in more than cursory detxiii. Cauldrons should be able 
to argue, conspire, and commune with each other. Metaphors about scientific communities and legislative 
bodies may well be useful at this level of detxiil. The only control or resolution structure tliis paper has 
motivated has been little different from classical subroutine invcK-ation-- the complexities and interactions 
within a given cauldron may well be as complicated as tlie political and social interactions within a given 
group of humans. 

Is the notion of "a collection of self interpreting assertions" presented here as a frame equivalent to the 
traditional notion of frame? 

The traditional notion of frames - of objects with properties - has a notion of identity, of the required 
propogation of side-effects, which is absent from the scheine presented here. I originally believed that tliis 
notion of identity was yet anotehr epistemological notion to be implemented explicitly by rules in individual 
cauldrons. A large protion of tlie rules written for cauldrons handled the propogation of frame modification 
from cauldron to cauldron. The utility and apparent universality of these mechanisms have brought me to 
believe that a notion of identity -- absent from the mechanism I have propsed -is neccessary in a 
rcpresetnation. Frames are attractive because they correspond to the introspective notion of distinct objects 
of thought- The frames of today's A I researchers are akin to the ideas dind //;//;rr5s/(>tm- of modern (read: the 
last M) years) philosophers. They are the objects of thought and perception to which we attribute properties 
and refer to by other properties. 

What about parallel implementations? 

As I mentioned before, I primarily consider cauldrons to be a mechanism for abstraction rather than 
problem distribution. However I have put some thought into possible schemes for parallelizing cauldrons. 
Cauldrons seem to fall on a level of concurrency somewhat below supercomputers like the Connection 
Machine [HillisSlJ. I sec cauldrons being best implemented on a collection of medium sized typical 
von-Ncumann connected by a fast bus - or in a pinch, a fast network. 

'ITic individual processors of this machine could range in scale from a fast 6800 to a current generation Lisp 
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Machine." Hach pr(x:css()r would probably contain between one and five cauldrons interacting largely -- if at 
all -- l(x:ally. In fact, most pr(x:cssors may contain just one cauldron with five connected cauldrons below it. 



22. Such as a Symbolics 3600 or a Xerox Dorado. 
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